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Amendments to the Claims : 

This listing of claims will replace all prior 
versions, and listings, of claims in the application: 

Listing of Claims: 

Claims 1-2. (Cancelled) 

3. (Currently Amended) The method according to claim 
2-3 8 , wherein the correlation is approximately equal to a ratio 
of an area of a logical AND between a figure obtained by 
moving one of the temporally adjacent first figures on the 
basis of a motion vector thereof and the other of the 
temporally adjacent first figures to an area of the one or the 
other of the temporally adjacent first figures. 

Claims 4-6. (Cancelled) 

7. (Currently Amended) The apparatus according to 
claim -6-39, wherein the correlation of the step (b) is 
approximately equal to a ratio of an area of a logical AND 
between a figure obtained by moving one of the temporally 
adjacent first figures on the basis of a motion vector thereof 
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and the other of the temporally adjacent first figures to an 
area of the one or the other of the temporally adjacent first 
figures . 



8. (Cancelled) 



9. (Currently Amended) A method of tracking moving 
objects in time-series pictures with processing the pictures, 
each picture being divided into blocks, each block consisting 
of a plurality of pixels, wherein an identification code of 
moving object is assigned in a unit of block, and a motion 
vector of moving object is determined in a unit of block, the 
method comprising the steps of, when a first block whose 
motion vector is not determined is present—: 

(a) picking up determined motion vectors of blocks 
surrounding the first block; 

(b) classifying the determined motion vectors into 
groups such that an absolute value of a difference between any 
two motion vectors in the same group is less than a 
predetermined value; and 

(c) estimating a motion vector of the first block to 
be approximately equal to an average of motion vectors 
belonging to one, having the largest number of motion vectors, 
of the classified groups. 
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10. (Original) The method according to claim 9, 
wherein when there is no determined motion vector to be picked 
up at the step (a) , the motion vectors estimated at the step 
(c) are regarded as determined motion vectors, and then the 
steps (a) to (c) are performed. 

11. (Original) An apparatus for tracking moving 
objects in time-series pictures, comprising: 

a storage device for storing the time-series 
pictures and a program; and 

a processor coupled to the storage device, 
wherein the program make the processor read and 
process the time-series pictures to track the moving objects 
in the pictures, and by the processing, each picture is 
divided into blocks, each block consisting of a plurality of 
pixels, an identification code of moving object is assigned in 
a unit of block, and a motion vector of moving object is 
determined in a unit of block, the program comprising the step 
of, when a first block whose motion vector is not determined 
is present, : 

(a) picking up determined motion vectors of blocks 
surrounding the first block; 
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(b) classifying the determined motion vectors into 
groups such that an absolute value of a difference between any 
two motion vectors in the same group is less than a 
predetermined value; and 

(c) estimating a motion vector of the first block to 
be approximately equal to an average of motion vectors 
belonging to one, having the largest number of motion vectors, 
of the classified groups. 

12. (Original) The apparatus according to claim 11, 
wherein the program further comprises the step of: when there 
is no determined motion vector to be picked up at the step 

(a) , regarding the motion vectors estimated at the step (c) as 
determined motion vectors, and then performing the steps (a) 
to (c) . 

13. (Original) A method of tracking moving objects 
in time-series pictures with processing the pictures, each 
picture being divided into blocks, each block consisting of a 
plurality of pixels, wherein in a case where an identification 
code of moving object is assigned in a unit of block, and a 
motion vector of moving object is determined in a unit of 
block, the method comprising the steps of: 
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(a) estimating a motion vector from a block-size 
region in a picture at a time tl to a region of interest in a 
picture at a time t2 as MV, and estimating an identification 
code of the block of interest as ID; 

(b) determining a correlation-related amount 
including an absolute value of a difference between the 
estimated motion vector MV of the block of interest and a 
motion vector of at least one, having an identification code 
equal to ID, of blocks surrounding the block of interest in 
the picture at the time t2; and 

(c) determining a value of an estimation function 
including the correlation-related amount for each first region 
moved within a predetermined range, and determining the motion 
vector MV and the identification code on the basis of an 
approximately-optimum value of the estimation function. 

14. (Original) The method according to claim 13, 
wherein the correlation-related amount of the step (c) is 
expressed by E | MV - MV ne ighbor I /L, where MV nei g h bor denotes a motion 
vector of a block having the same identification code as the 
identification code ID of the block of interest, within blocks 
surrounding the block of interest, S denotes a sum over the 
blocks having said same identification code ID, and L denotes 
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a number of the blocks having said same identification code 
ID. 



15. (Original) An apparatus for tracking moving 
objects in time-series pictures, comprising: 

a storage device for storing the time-series 
pictures and a program; and 

a processor coupled to the storage device, 

wherein the program make the processor read and 
process the time-series pictures to track the moving objects 
in the pictures, and by the processing, each picture is 
divided into blocks, each block consisting of a plurality of 
pixels, in a case where an identification code of moving 
object is assigned in a unit of block, and a motion vector of 
moving object is determined in a unit of block, the program 
comprising the step of: 

(a) estimating a motion vector from a block-size 
region in a picture at a time tl to a region of interest in a 
picture at a time t2 as MV, and estimating an identification 
code of the block of interest as ID; 

(b) determining a correlation-related amount 
including an absolute value of a difference between the 
estimated motion vector MV of the block of interest and a 
motion vector of at least one, having an identification code 
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equal to ID, of blocks surrounding the block of interest in 
the picture at the time t2; and 

(c) determining a value of an estimation function 
including the correlation-related amount for each first region 
moved within a predetermined range, and determining the motion 
vector MV and the identification code on the basis of an 
approximately-optimum value of the estimation function. 

16. (Original) The apparatus according to claim 15, 
wherein the correlation-related amount of the step (c) is 
expressed by £ | MV - MV ne ighbor I /L, where MV ne i g hbor denotes a motion 
vector of a block having the same identification code as the 
identification code ID of the block of interest, within blocks 
surrounding the block of interest, £ denotes a sum over the 
blocks having said same identification code ID, and L denotes 
a number of the blocks having said same identification code 
ID. 

Claims 17-20. (Cancelled) 

21. (Original) An apparatus for tracking moving 
objects in time-series pictures, comprising: 

a storage device for storing the time-series 
pictures and a program; and 
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a processor coupled to the storage device, 
wherein the program make the processor read and 
process the time-series pictures to track the moving objects 
in the pictures, and by the processing, each picture is 
divided into blocks, each block consisting of a plurality of 
pixels, the program comprising the step of: 

(bl) determining motion vectors of respective blocks 
in a picture at a time t2 through the use of block matching 
between a picture at a time tl and the picture at the time t2, 
without discriminating between the background image and moving 
objects ; 

(b2) determining motion vectors of blocks, which are 
not determined at the step (bl), by estimating the motion 
vectors through the use of the method according to any one of 
claims 9, 13 or 14; and 

(b3) assigning the same identification code to 
adjacent blocks if an absolute value of a difference between 
motion vectors of the adjacent blocks is less than a 
predetermined value . 

Claims 22-23. (Cancelled) 
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24. (Currently Amended) The method according to a**y 
one of claim— 2-2 — or 23 42 , wherein the region of interest of 
the step (a) corresponds to one block. 

25. (Currently Amended) The method according to any 
one of claim 22 or 23 42 , wherein the object map of the step 
(a) is a new object map, and at the step (b) , the region of 
interest is moved in the negative direction of the motion 
vector . 

26. (Currently Amended) The method according to any 
one — of clai m 22 — ene — 2-3 - 42 , wherein the number of the plurality 
of object maps is kept constant by updating an oldest object 
map with a newest object map. 

27. (Currently Amended) The method according to any 
e**e — of clai m 22 — e^e — 23 - 42 , wherein, on the basis of both a 
region of interest at a time tl and a corresponding region of 
interest at a time t2, a motion vector from the time tl to the 
time t2 is determined as a fast-forward motion vector, and 

wherein if a difference of an absolute value an 
absolute value of a difference between respective fast-forward 
motion vectors of two adjacent regions of interest on the 
object map of the time t2 is more than a predetermined value, 
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the two adjacent regions of interest are recognized as 
different moving objects. 

28. (Original) The method according to claim 27, 
wherein, if a plurality of peaks are present in a histogram of 
absolute values of motion vectors for a single cluster 
including adjacent blocks having motion vectors, an interval 
between the times tl and t2 is determined on the basis of a 
speed difference between the peaks. 

29. (Original) The method according to claim 27, 
wherein each time the interval between the times tl and t2 is 
increased, it is determined whether or not the absolute value 
of the difference between the respective fast-forward motion 
vectors of the two adjacent regions of interest on the object 
map of the time t2 is more than the predetermined value, and 

wherein if the interval is less than a predetermined 
maximum value and if the absolute difference is more than the 
predetermined value, then the two adjacent regions of interest 
are recognized as different moving objects. 

Claims 30-31. (Cancelled) 
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32. (Currently Amended) The apparatus according to 
any one of clai m 30 or 31 43 , wherein the region of interest 
of the step (a) corresponds to one block. 

33. (Currently Amended) The apparatus according to 
any one of claim— 3-Q — or 31 43 , wherein the object map of the 
step (a) is a new object map, and at the step (b) , the region 
of interest is moved in the negative direction of the motion 
vector . 

34. (Currently Amended) The apparatus according to 
any one — e^— claim 30 or 31 43 , wherein the program further 
comprises the step of: 

keeping the number of the plurality of object maps 
constant by updating an oldest object map with a newest object 
map . 

35. (Currently Amended) The apparatus according to 
any one of claim 30 or 31 43 , wherein the program further 
comprises the step of: 

on the basis of both a region of interest at a time 
tl and a corresponding region of interest at a time t2, 
determining a motion vector from the time tl to the time t2 as 
a fast-forward motion vector; and 
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if a — dif f crcncQ — of an absolute — value an absolute 
value of a difference between respective fast-forward motion 
vectors of two adjacent regions of interest on the object map 
of the time t2 is more than a predetermined value, recognizing 
the two adjacent regions of interest as different moving 
ob j ects . 

36. (Original) The apparatus according to claim 35, 
wherein the program further comprises the step of: 

if a plurality of peaks are present in a histogram 
of absolute values of motion vectors for a single cluster 
including adjacent blocks having motion vectors, determining 
an interval between the times tl and t2 on the basis of a 
speed difference between the peaks. 

37. (Original) The apparatus according to claim 35, 
wherein the program further comprises the step of: 

each time the interval between the times tl and t2 
is increased, determining whether or not the absolute value of 
the difference between the respective fast-forward motion 
vectors of the two adjacent regions of interest on the object 
map of the time t2 is more than the predetermined value; and 

if the interval is less than a predetermined maximum 
value and if the absolute difference is more than the 
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predetermined value, recognizing the two adjacent regions of 
interest as different moving objects. 

38. (New) A method of tracking moving objects in 
time-series pictures with processing the pictures, each 
picture being divided into blocks, each block consisting of a 
plurality of pixels, wherein in a case where an identification 
code of moving object is assigned in a unit of block, and a 
motion vector of moving object is determined in a unit of 
block, the method comprising the steps of: 

(a) for each of N (N>2) consecutive pictures within 
the time-series pictures, assigning the same identification 
code to adjacent blocks if an absolute value of a difference 
between motion vectors of the adjacent blocks is less than a 
predetermined value, thereby allowing different identification 
codes to be assigned to different moving objects overlapping 
in a picture; 

(b) judging whether or not: a first object 
consisting of a group of blocks assigned a first 
identification code and a second object consisting of a group 
of blocks assigned a second identification code are in contact 
with each other in each of the N consecutive pictures; and a 
correlation between the first objects in every temporally 
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adjacent pictures in the N consecutive pictures is more than a 
predetermined value ; 

(c) tracking the first and second objects backward in time 
after the judgment of the step (b) is positive. 

39. (New) An apparatus for tracking moving objects 
in time-series pictures, comprising: 

a storage device for storing the time-series 
pictures and a program; and 

a processor coupled to the storage device, 

wherein the program make the processor read and 
process the time-series pictures to track the moving objects 
in the pictures, and by the processing, each picture is 
divided into blocks, each block consisting of a plurality of 
pixels, an identification code of moving object is assigned in 
a unit of block, and a motion vector of moving object is 
determined in a unit of block, the program comprising the step 
of: 

(a) for each of N (N>2) consecutive pictures within 
the time-series pictures, assigning the same identification 
code to adjacent blocks if an absolute value of a difference 
between motion vectors of the adjacent blocks is less than a 
predetermined value, thereby allowing different identification 



17 



In re of: KAMI JO 1 



codes to be assigned to different moving objects overlapping 
in a picture; 

(b) judging whether or not: a first object 
consisting of a group of blocks assigned a first 
identification code and a second object consisting of a group 
of blocks assigned a second identification code are in contact 
with each other in each of the N consecutive pictures; and a 
correlation between the first objects in every temporally 
adjacent pictures in the N consecutive pictures is more than a 
predetermined value; and 

(c) tracking the first and second objects backward in time 
after the judgment of the step (b) is positive. 

40. (New) A method according to any one of claims 13 
or 14, wherein a background image is regarded as a moving 

ob j ect . 

41. (New) A method of tracking moving objects in 
time-series pictures with processing the pictures, the method 
comprising the steps of: 

(a) dividing each picture into blocks, each block 
consisting of a plurality of pixels; and 

(b) with regarding a background image as a moving 
object, assigning an identification code of moving object in a 
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unit of block and determining a motion vector of the moving 
object in a unit of block; 

wherein the step (b) comprises the steps of: 
(bl) determining motion vectors of respective blocks 
in a picture at a time t2 through the use of block matching 
between a picture at a time tl and the picture at the time t2, 
without discriminating between the background image and moving 
objects; 

(b2) determining motion vectors of blocks, which are 
not determined at the step (bl), by estimating the motion 
vectors through the use of the method according to any one of 
claims 9, 13 or 14; and 

(b3) assigning the same identification code to 
adjacent blocks if an absolute value of a difference between 
motion vectors of the adjacent blocks is less than a 
predetermined value . 

42. (New) A method of tracking a moving object in 
time-series pictures with processing the pictures, each 
picture being divided into blocks, each block consisting of a 
plurality of pixels, 

wherein a plurality of object maps of different 
times have been stored, each object map having motion vectors 
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of the moving object in a unit of block, the method comprising 
the steps of : 

(a) determining a motion vector of a region of 
interest for one of the plurality of object maps; and 

(b) determining a motion vector of a region, to 
which the region of interest is moved with using the 
determined motion vector in positive or negative direction 
thereof, on the basis of an object map at a time corresponding 
to completion of the movement of the region, 

wherein the moved region is set as a region of 
interest on the object map of the time corresponding to the 
completion of the movement of the region, and the step (b) is 
repeated a plurality of times to track the region of interest, 
wherein at the step (a) or the step (b) , a weighted motion 
vector average is determined as a motion vector of the region 
of interest with using motion vectors of blocks overlapping 
with the region of interest, where weights given to the 
respective motion vectors correspond to the number of pixels 
of respective portions overlapping between the respective 
blocks and the region of interest. 

43. (New) An apparatus for tracking moving objects 
in time-series pictures, comprising: 
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a storage device for storing the time-series 
pictures and a program; and 

a processor coupled to the storage device, 
wherein the program make the processor read and 
process the time-series pictures to track the moving objects 
in the pictures, and by the processing, each picture is 
divided into blocks, each block consisting of a plurality of 
pixels, a plurality of object maps of different times have 
been stored, each object map having motion vectors of the 
moving object in a unit of block, the program comprising the 
step of: 

(a) determining a motion vector of a region of 
interest for one of the plurality of object maps; and 

(b) determining a motion vector of a region, to 
which the region of interest is moved with using the 
determined motion vector in positive or negative direction 
thereof, on the basis of an object map at a time corresponding 
to completion of the movement of the region, 

wherein the moved region is set as a region of 
interest on the object map of the time corresponding to the 
completion of the movement of the region, and the step (b) is 
repeated a plurality of times to track the region of interest, 
wherein at the step (a) or the step (b) , a weighted motion 
vector average is determined as a motion vector of the region 
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of interest with using motion vectors of blocks overlapping 
with the region of interest, where weights given to the 
respective motion vectors correspond to the number of pixels 
of respective portions overlapping between the respective 
blocks and the region of interest. 
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